Learning to Choose Instance-Specific Macro Operators

نویسنده

  • Maher Alhossaini
چکیده

The acquisition and use of macro actions has been shown to be effective in improving the speed of AI planners. Current macro acquisition work focuses on finding macro sets that, when added to the domain, can improve the average solving performance. In this paper, we present Instance-specific macro learning. This kind of macro filtering depends on building a predictor that can be used to estimate, for each planning instance, the best subset of a previously collected set of macros to speed up the planning. Learning the predictor is done off-line based on the observed correlation between problem instance features and planner performance in macroaugmented domains. Our empirical results over five standard planning domains demonstrate that our predictors perform as well as the non-instance-specific method that chooses the best-on-average macro, and that there is a chance of improving the performance significantly using instance specific macros. Also in this paper, we tackle the problem of choosing macros from a large set of initial macros as well. We show that in this case approximate methods can produce macro sets that are comparable to the best macro sets.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Instance-Specific Remodelling of Planning Domains by Adding Macros and Removing Operators

We propose an approach to remodelling classical planning domains via the addition of macro operators and removal of original operators either for the domain as a whole or instance-by-instance. For the latter remodelling, we train a predictor to choose the best reformulation of the domain based on instance characteristic. In the domain level remodelling, we try find a fixed remodelling that work...

متن کامل

Macro Learning in Planning as Parameter Configuration

In AI planning, macro learning is the task of finding subsequences of operators that can be added to the planning domain to improve planner performance. Typically, a single set is added to the domain for all problem instances. A number of techniques have been developed to generate such a macro set based on offline analysis of problem instances. We build on recent work on instance-specific and f...

متن کامل

Roles of Macro - Actions in Accelerating Reinforcement

We analyze the use of built-in policies, or macro-actions, as a form of domain knowledge that can improve the speed and scaling of reinforcement learning algorithms. Such macro-actions are often used in robotics, and macro-operators are also well-known as an aid to state-space search in AI systems. The macro-actions we consider are closed-loop policies with termination conditions. The macro-act...

متن کامل

Selective Learning of Macro-operators with Perfect Causality

A macro-operator is an integrated operator consisting of plural primitive operators and enables a problem solver to solve more efficiently. However, if a learning system generates and saves all macro-operators extracted from worked examples, they will increase explosively and eventually its problem solving will be less efficient than even a non-learning system. Thus, it is very important for ma...

متن کامل

Combining Macro-operators with Control Knowledge

Inductive Logic Programming (ilp) methods have proven to succesfully acquire knowledge in very different learning paradigms, such as supervised and unsupervised learning or relational reinforcement learning. However, very little has been done on General Problem Solving (gps). One of the ilp-based approaches applied to gps is hamlet. This method is able to learn control rules (heuristics) for a ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2010